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©Hybrid Image-Plane/Stereo Manipulation 

This method is robust in the face of calibration errors. 


NASA’s Jet Propulsion Laboratory, Pasadena, California 



A Stereoscopic Pair of Electronic Cameras on a legged mobile exploratory robot acquires images of a 
scene that includes a manipulator arm and a target. The image data are used to guide the end effec- 
tor of the manipulator toward the target. 


Hybrid Image-Plane/Stereo (HIPS) 
manipulation is a method of processing 
image data, and of controlling a robotic 
manipulator arm in response to the 
data, that enables the manipulator arm 
to place an end-effector (an instrument 
or tool) precisely with respect to a target 
(see figure). Unlike other stereoscopic 
machine-vision-based methods of con- 
trolling robots, this method is robust in 
the face of calibration errors and 
changes in calibration during operation. 

In this method, a stereoscopic pair of 
cameras on the robot first acquires im- 
ages of the manipulator at a set of pre- 
defined poses. The image data are 
processed to obtain image-plane coor- 
dinates of known visible features of the 
end-effector. Next, there is computed 
an initial calibration in the form of a 
mapping between (1) the image-plane 
coordinates and (2) the nominal three- 
dimensional coordinates of the noted 
end-effector features in a reference 
frame fixed to the main robot body at 
the base of the manipulator. The nomi- 
nal three-dimensional coordinates are 
obtained by use of the nominal forward 
kinematics of the manipulator arm — 
that is, calculated by use of the cur- 
rently measured manipulator joint an- 
gles and previously measured lengths of 
manipulator arm segments under the 
assumption that the arm segments are 
rigid, that the arm lengths are constant, 
and that there is no backlash. It is un- 


derstood from the outset that these 
nominal three-dimensional coordinates 
are likely to contain possibly significant 
calibration errors, but the effects of the 
errors are progressively reduced, as de- 
scribed next. 

As the end-effector is moved toward 
the target, the calibration is updated 
repeatedly by use of data from newly 
acquired images of the end-effector 
and of the corresponding nominal co- 
ordinates in the manipulator refer- 
ence frame. By use of the updated cal- 
ibration, the coordinates of the target 
are computed in manipulator-refer- 
ence-frame coordinates and then used 
to the necessary manipulator joint an- 
gles to position and orient the end-ef- 
fector at the target with respect to the 


same kinematic model from the cali- 
bration step. As the end-effector/ tar- 
get distance decreases, the computed 
coordinates of the end-effector and 
target become more nearly affected by 
the same errors, so that the differences 
between their coordinates become in- 
creasingly precise. When the end-ef- 
fector reaches the target, the remain- 
ing effective position error is the 
distance that corresponds to more 
than about one pixel in the stereo- 
scopic images of the target. 

This work was done by Eric Baumgartner 
and Matthew Robinson of Caltech for 
NASA’s Jet Propulsion Laboratory. Fur- 
ther information is contained in a TSP (see 
page 1). 

NPO-30492 


Partitioning a Gridded Rectangle Into Smaller Rectangles 

A relatively simple algorithm yields nearly square, nearly equally sized segments. 

NASA’s Jet Propulsion Laboratory, Pasadena, California 


A relatively simple algorithm, devised 
for use in an image-data-compression 
application, partitions a rectangular pix- 
elated image (or any other rectangle on 
which a regular rectangular grid has al- 
ready been superimposed) into a speci- 
fied number of smaller rectangles, here- 
after denoted segments. The algorithm 
has the following properties: 


• No floating-point operations are 
needed. 

• The segments tend to be nearly square 
(in the sense that their widths and 
heights in pixel units tend to be nearly 
equal) . 

• The segments tend to have nearly 
equal areas. 

• The algorithm yields valid results (no 


zero-width or zero-height segments) as 
long as the specified number of seg- 
ments, 5, does not exceed the number 
of pixels (equivalently, the number of 
grid cells) . 

The inputs to the algorithm are the 
positive integer 5 plus the positive inte- 
gers h and w, denoting the height and 
width, respectively, of the rectangle in 
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A Rectangular Image of 10 by 14 pixels is partitioned into 17 segments by the algorithm described in 
the text. 


pixel units. The limit on 5 for a valid re- 
sult is given by s < wh. 

The output of the algorithm is char- 
acterized by, and can be described 
completely in terms of, several para- 
meters that are illustrated by the ex- 
ample shown in the figure. The seg- 
ments are arranged in r rows. A top 
region of the rectangle contains seg- 
ments arranged in c columns. A possi- 
ble bottom region contains segments 
arranged in c + 1 columns. The top re- 
gion has height h t and contains r t rows 
of segments. The first r t o rows of seg- 
ments in the top region have height y t ; 
the remaining rows (if any) in the top 


region have height y t + 1. The first r t o 
columns in the top region have width 
x t ; any remaining columns in the top 
region have width x t + 1 . Similarly, the 
first rbo rows in the bottom region have 
height yt» and the remaining rows in 
the bottom region have height y b + 1, 
while the first rbO columns in the bot- 
tom region have width Xb and the re- 
maining columns in the bottom region 
have width Xb + 1. 

The steps of the algorithm are the fol- 
lowing: First, r is computed. If/^>(.s-l)&; 
then r= s. Otherwise, ris the unique pos- 
itive integer that satisfies 

(r- 1 )rw< hs< (r + 1 )rw. 


Some of the other parameters are 
computed as follows: 
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If r t < r, so that there is a bottom re- 
gion, then the remaining parameters are 
computed as follows: 
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It has been verified by straightfor- 
ward algebraic analysis of these equa- 
tions that the algorithm has the proper- 
ties mentioned in the first paragraph. 

This work was done by Matthew Klimesh 
and Aaron Kiely of Caltech for NASA’s Jet 
Propulsion Laboratory. Further informa- 
tion is contained in a TSP (see page 1). 

This software is available for commercial 
licensing. Please contact Don Hart of the Cal- 
ifornia Institute of Technology at (818) 393- 
3425. Refer to NPO-30479. 


Digital Radar-Signal Processors Implemented in FPGAs 

Processing can be performed onboard at relatively low power. 
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High-performance digital electronic 
circuits for onboard processing of re- 
turn signals in an airborne precipita- 
tion-measuring radar system have 
been implemented in commercially 
available field-programmable gate ar- 
rays (FPGAs). Previously, it was stan- 
dard practice to downlink the radar-re- 
turn data to a ground station for 
postprocessing — a costly practice that 


prevents the nearly-real-time use of the 
data for automated targeting. In princi- 
ple, the onboard processing could be 
performed by a system of about 20 per- 
sonal-computer-type microprocessors; 
relative to such a system, the present 
FPGA-based processor is much smaller 
and consumes much less power. Alter- 
natively, the onboard processing could 
be performed by an application-specific 


integrated circuit (ASIC), but in com- 
parison with an ASIC implementation, 
the present FPGA implementation of- 
fers the advantages of ( 1 ) greater flexi- 
bility for research applications like the 
present one and (2) lower cost in the 
small production volumes typical of re- 
search applications. 

The generation and processing of 
signals in the airborne precipitation- 
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